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(54) RECOGNIZING METHOD OF STEP OR THE LIKE OF MOVING BODY 

(57)Abstract: 

PURPOSE: To easily recognize an obstacle such as a step or the like and to obtain 
the positional information of the obstacle by treating an image obtained by a visual 
sensor through a binary process, forming a binary image, and obtaining the area of the 
image of one of the two values. 

CONSTITUTION: An image processing unit binarizes an image obtained from a visual 
sensor thereby to obtain a binary image and extracts the white area. Then, the 
longest part, a starting point and an ending point of the longest part in the white area 
are obtained for every scanning line in an image memory, so that a quadrilateral is 
formed. It is subsequently detected whether the white parts are connected each 
other. The starting line and tire ending line of the connected parts are stored and the 
area is calculated. The above process is carried out for each diagram output from two 
visual sensors, thereby to obtain the right and left diagrams. Then, the right and left 
quadrilaterals symmetric to each other are determined. The coordinates of four end 
points of the right, and left quadrilaterals determined to correspond to each other are 
compared. It is detected whether the distance of the points is within the range 
smaller than a predetermined value. The trigonometrical measurement is conducted 
for each end point of the pair showing the distance smaller than the predetermined 
value. 
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[0 0 0 7] 

Oo#yH Sr^flcW«w»-^KW^<r/^ h>mxh*) , 
fe*-tn-?fix^>Wffl(-6floB8ffl ($4) £{S£5 

^T*ft6) c K6<BcO|Slffl (W) ttJi^felWw, ffi 
OW«Ettffi<7>M«Mtt) 10R, 10L C&ftlSrR, 

ffil) <Z>B8ffl5 (**) 12R, 12L, Ha — yO^ft ( y # 
[61) OBSffli (tt) 14R, 14L, K»OfcTy^*fS]^ 
HAS (fft) 16R, 16L. JE*W<Otrty^*|Sl©BB«S 
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x <D*:fcfflcO x y ffitS 
x Og/JMtO x y ffitS 
y COfi^ffiCO x y Mtl 



[ooi5]«v^si0 2i:i*, SIS^l^ • 
S 1 0 4-C*ftfc^PillOE«4rlHH^ sio6n 

Tx, y, x + y, x-y tf>**. ft/hSr^x. 5i£tf 

5 0 r r "C*^o/cx, y, x + y, x-y <DM± • M'Hfe 



: max x = (max xx, max xy) 

: min x = (rain xx, min xy) 

: max y = (max yx, max yy) 

: min y = (min yx, min yy)) 

x + y^f^l<7)x yli : max x + y = (max xpyx, max xpyy) 

x + y (DMl'N\M.<7) x y Mtl : min x +y — (min xpyx, min xpyy) 

x — y (Dflk^W-V) x y Mtl : max x — y = (max xmyx, max xmyy) 

x — y <DM / H\M.<F> x yMtl : min x — y =(min xmyx, min xmyy) 

[0 0 16] ±T^fe/c8O^te^bII^08o 

Top Right = (min yx — max xmyx)* + (min yy 

Top Left — (min yx — min xpyx) 2 4- (min yy 

Bottom Right— (max yx — max xpyx) 2 + (max yy 



Bottom Left = (max yx - 
Max Up — (max xx - 

Max Down = (max xx - 
Min Up = (min xx - 

Min Down = (min xx - 
i:i5(Cjo^Tmax, min, up, downfi x $&{Clf|ij LT 

bottom, left, right (1 y f&lCBf] LTaeSI LT^-5^\ 
±"C£ilfc8oOl»»iH:, -tOlttKJtttLfcx, y, 
x + y, x-y <DMl* • ft/J^fflSr#x.SffiBffiar«^ffi«6 

^ h/U^4 0(7?^Pg(Cjo^T (l, 0) , (0, l) , 
(1,1), (1,-1) oaU»Wi:»«o#«OJbffl 
5 0 a a>&3ft*ofcE32Hi^tt.*i ^ott^ 0 

2ocog^i5^«lcifi^d^|B]i:»'&li, Ell 

3<0«M, 2 522<0*rfi]dSfeS 

Hi 4^?>EI2 3T\ 2Oc0tE^^^^>5^{-^^TEg 
«S 1 4 (0»^i±Top Right 0 5<h#C20 



min xmyx) 2 + (max yy 

max xmyx) 2 + (max xy 

max xpyx) 2 4- (max xy 

min xpyx) 2 + (min xy 

min xmyx) 2 4- (min xy 
top, 



max xmyy) 2 
min xpyy) 2 
max xpyy) 2 
min xmyy) 2 
max xmyy) 2 
max xpyy) 2 
min xpyy) 2 
min xmyy)* 

<7}52##£1-5$a(S£^LT^6 0 Z<D^^^mi 4 

gas<fc oafcv^-frfcjtottsrir^-cifc*. «x.rf, to 

p Right = 0;6>oTop Left=OCOE3 2 2 <0$S-§\ 2m<D 

*o<. * b^Jfcv^afSr«JR1"5»**i> 8o<o#ti 

«rt-Cft<, «ffcfta*-frk>-fr«:x, y, x + y. x-y <D 
[0017] t^TS108 jo^T*^<^ffiSBB«^ 
5 0 Af*W(£K9l1-a<!:, Hli:*tD*y M*»» 
/U-/U-C»a-^« r t 5 COT, ttLKSEo T*USU 
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(a) (IE! 2 4) 

Min Down< 6 ^OMax Down< 6 (Bottom Left< 

5 ^/cteBottom Right< 6) „ I min xpyy — ma 

x xmyy | < e /$*0 | min xmyy — max xpyy | < f 

(b) £T*±«AHi2» (125) 

±0 (a) cDf£ft£^£f\ Max Up< 6 ri-OTop Ri 
ght < 5 #>OMin Down< 5 T^oBottom Left < 6 ft 
6>tf, i£T*±ft*IHjaW. 

(c) fiitTSWI (12 2 6) 

(a) (b) OftftSridfcS-f, Min Up< 6 ri>oTop 
Left< 5 /6>oBottomRight < 6 #>oMax Down< 5 
btf, 4£±*T«*B35ZI». 

(d) 1SWLf\ (127) ifcttfctta (128) 
(a) (b) (c) ©*f**ri«fc*1\ MinUp<6 

OMin Down< 6 , £fcf2Max Up< 6 £>OMax Down< 6 

(e) -^c^fiii 

(a) (b) (c) (d) (75£f*£iBfc£fc^»£\ *T 

eg ia » * vttE^m m m m 0 
[ooi8] iv^ts i i o.x-mmi&<DW5& : &i&ttiir 

(a ) ^ (12 4) 
(trx, try) = (max xmyx, max xmyy) 
(tlx, tly) = (min xpyx, min xpyy) 
(brx, bry) = (max xpyx, max xpyy) 
(blx, bly) = (rain xmyx, min xmyy) 

(b) 2ET*-httA (12 5) 
(trx, try) = (max xmyx, max xmyy) 
(tlx, tly) = (min xpyx, min xpyy) 
(brx,' bry) '= (max xpyx," "max ~xpyy) 
(blx, bly) = (min xmyx, min xmyy) 

(c) tE.±&TVL* (12 6) <D&& 
(trx, try) = (max xmyx, max xmyy) 
(tlx, tly) = (min xpyx, min xpyy) 
(brx, bry) = (max xpyx, max xpyy) 
(blx, bly) = (min xmyx, min xmyy) 

(d) Izmk (12 7) SfctefeSfcfc (12 8) <D*Jr^ 

•y^rMin [i ] , »;b9£:Max [i ] t1rZ>t%. 

Max [St -fa] -Max [St] < Min [St] - Min [St + 

a] 

( a (iiS^^i-^IE^^) 0 

(trx, try) = (min yx f min yy) 
(tlx, tly) = (min xx, min xy) 



(brx, bry) = (max xx, max yy) 
(blx, bly) = (max yx, max yy) 

(trx, try) = (max xx, max xy) 

(tlx, tly) = (min yx, min yy) 

(brx, bry) = (max yx, max yy) 

(blx, bly) = (min xx, min xy) 

(e) tOffi mm® (13 0) % tEtiffl (13 1) ) 

(trx, try) = (min yx, min yy) 

(tlx, tly) = (min xx, min xy) 

(brx, bry) = (max xx, max xy) 

(blx, bly) = (max yx, max yy) 

Min Down< 5 £ fcteBottom Left < 5 

ifcttTop Right < 5 /6>oBottom Left < 5 /6>OMa 

x Down< 6 t£h& 

(tlx, tly) == (min xpyx, min xpyy) 

(trx, try) = (max xmyx, max xmyy) 
(tlx, tly) = (min xpyx, min xpyy) 

1 0 h) ELh*>S*frtt 
(brx> bry) = (max xpyx, max xpyy) 
(blx, bly) = (min xmyx, min xmyy) 

(trx, try) = (max xx, max xy) 

(tlx, tly) == (min yx, min yy) 

(brx, bry) = (max yx, max yy) 

(blx, bly) = (min xx, min xy) 

-e*>*'**; 

Max Down< 5 £fct£Bottom Right < 6 

£fcttTop Left< 6 ri>OBottom Right< 5 £>OMin 

Down< 6 fcbtf 

(trx, try) = (max xmyx, max xmyy) 

$ (0ij^fi l 0 h) EJLhfcSii-frli 
(trx, try) — (max xmyx, max xmyy) 
(tlx, tly) = (min xpyx, min xpyy) 

ifil 0 h) £JLb 

(brx, bry) = (max xpyx, max xpyy) 

(blx, bly) = (min xmyx, min xmyy) 

[0 0 19] Wii^tftPADlCIih jgc^T 

i"-5 c #«^H»<^max x(min x) 4:iS«E$-^"C 
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X&«8LX LT»fcHW WIS ft fc<&a>5jMWr 
[0 0 2 0] 2fi^-<>—> ? ir>'f-3 6^ 

= L4v> (HulHl^dJL^EI^ 

[0 0 2 1 ] IPTS 6(CilA/tf»«-rSi:«»*nfc 
IS 4 o<o«*OY MSI £ -t ix^ixttifc L , 

ss^c»os^c-*ftT=:^fiy*Srff 5o Sana* 

fc«L*i:JLttSi\ 4fc*«J«^tt 
IS 3 2ic^i-^(c, fc*W«d*6S#fHl!.9«i:#**:f+ 

(x,y) = (d(Xl +Xr)/(X1-Xr), 2fd/(Xl-Xr)) 

jEris&^i: ft<52&5. H^S'Jl:g^tfw(0^(DSi*<b:-r 
5 4: d ^teftl^<0T\ »MttRffl#i*»-r , 5" 0 " 
[0 0 2 2] K^XS 7JCJBA/-e#b*Lfcffillffi«S:Sf 

[0 0 2 3] roHlE«iJtt-hSBOiD<«fiS;Lte<0-C. 
SSra^dMcBK LT-fc<D<a:«jffi««r?#5 r i: d«-e# 

Tt^Ii: Lft^ft-Cfc'J fttf s fe, SSd^offiiS^pg 

»KAft$;L^Hti\ »aojE*ft3ite7cfit«W«S:l8l 
eStiJt^ld:^, ^^ffbttfeifiElttlftiif^jE 
»4fii«f«*^St Lftv\ wOttKiO, IS, * 
»Bf ft if "C d si? * h (c»«*:4trlWWK«:fc*5* 

9fftif(c|««i-5i:#, Ba^±I^*Sr»tJ:9*: 



[0 0 2 4) Sfc±ELfc*tt«lwfc^fttTop Right 

ft if 8ooiwtitffl^fc*^ wiz.&mmztmZ'&z 

w i: K i o T 5 522«Bil±<OJB«SrK*Ji- 5:it "T££~C 
^>ttO-Cllft<. ^ffift^^-CfCJSffl^ftt^-Xffc 
[0 0 2 5] ifcH4«5S 

[0 0 2 6] M^li, jHft«tLT2JE*?Ta>JWa»» 

— 9S!fcif<0o«K5' He fc SMS Mfete 
-e tt ft v ^ A jfefrSft if ( - 1 JCffl ^Tfi6 ft t o ~C 

£o 

[0 0 2 7] 

t LTM^ 2 «MI^M^±I^ ^ ^ , Wg» 
*^^rt&I/1f*rtOiij^i:(i^ft5tti^ffi^}toJ: 

r a tfrgE^fe2ffl iiifft(wjBtt^sllt^^, XtfffiE* 

£a>bft5*D<«/SLfcO-C\ 8#4SjfiTfcotfffl 
C0^n- K^^Tftif Sr^Sir-fr-f i:#S*«:S»t5: 

[0 0 2 8] W*J2g[fi, l oifctt*RO«JE-&> 
-0- & * U * ft b » b ft 3 W« «r*%Ul L -C»»fM» 

^la^fe^Ts TWIE«Jt-tr>'+^e>»?>ix5lii« 

*««rtfttf**rt^ffi*i:ttJlttSU*tt*^«t ^ 
ft^jKco^r<0 2ffiljtt frffk iulEM^ 2fi£tS^lco 

b ffllE^MjScO 3 * Tcffi fi » tb -T S CI i: * ^ft^)*D< 
fti:'«r^gir-^"f . ^ffift^mif (cAix^ itnif, ^ 
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j^0 3Jfe5cft«ffi«*l»#*Uii"S-^* s ^*- ^ 
ft h ft it USUI ««* if ^ 3E» ftfi: fit # £ t L * 

[0 0 2 9] "MEkzfe^ffi^ £ ^^^s 

[12] ii(c^t>r^- i/^is-y-viw&t^vot&w 

[0 3] r<0«W^5*ft^^^^K®4:^!aW : 

#«b-?#>5. v 

[i4] Hi \zfF'tW&&M=>--y Vti}'ao •. 

[El 5] B 4 OP ADH«?f KfiW^ttttl 
ff*3fi£^^3/P AD0-efc5c ;"' 

[|6] HSPADBofeWWOftU'^^^rttWE? 
co — pft -CWB« W #p fc 5 o ; 
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